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ABSTRACT 

Objectives: To determine the level of agreement 
between a 'conventional' Ankle-Brachial Index (ABI) 
measurement (using Dopplerand mercury 
sphygmomanometer taken by a research nurse) and a 
'pragmatic' ABI measure (using an oscillometric device 
taken by a practice nurse) in primary care. To ascertain 
the utility of a pragmatic ABI measure for the diagnosis 
of peripheral arterial disease (PAD) in primary care. 
Design: Cross-sectional validation and diagnostic 
accuracy study. Descriptive analyses were used to 
investigate the agreement between the two procedures 
using the Bland and Altman method to determine 
whether the correlation between ABI readings varied 
systematically. Diagnostic accuracy was assessed via 
sensitivity, specificity, accuracy, likelihood ratios, 
positive and negative predictive values, with ABI 
readings dichotomised and Receiver Operating Curve 
analysis using both univariable and multivariable 
logistic regression. 

Setting: Primary care in metropolitan and rural 
Victoria, Australia between October 2009 and 
November 2010. 

Participants: 250 persons with cardiovascular 
disease (CVD) or at high risk (three or more risk 
factors) of CVD. 

Results: Despite a strong association between the two 
method's measurements of ABI there was poor 
agreement with 95% of readings within ±0.4 of the 0.9 
ABI cut point. The multivariable C statistic of diagnosis 
of PAD was 0.89. Other diagnostic measures were 
sensitivity 62%, specificity 92%, positive predictive 
value 67%, negative predictive value 90%, accuracy 
85%, positive likelihood ratio 7.3 and the negative 
likelihood ratio 0.42. 

Conclusions: Oscillometric ABI measures by primary 
care nurses on a population with a 22% prevalence of 
PAD lacked sufficient agreement with conventional 
measures to be recommended for routine diagnosis of 
PAD. This pragmatic method may however be used as 
a screening tool high-risk and overt CVD patients in 
primary care as it can reliably exclude the condition. 



ARTICLE SUMMARY 



Article focus 

■ To determine the agreement between AnkleBrachial 
Index (ABI) measured by Doppler and mercury 
sphygmomanometer by research nurse and that of 
general practice nurse measurement with an oscillo- 
metric device. 

■ To ascertain the utility of oscillometric devices for 
the diagnosis of peripheral arterial disease (PAD). 

Key messages 

■ Oscillometric ABI measures by primary care 
nurses on a population with a 22% prevalence 
of PAD lacked sufficient agreement with conven- 
tional measures to be recommended for routine 
diagnosis of PAD. 

■ This pragmatic method may, however, be used 
as a screening tool in high-risk primary care 
patients as it can reliably exclude the condition. 

Strengths and limitations of this study 

■ This validation study was conducted in primary 
care where undiagnosed PAD is likely to be found. 

■ The intervention was kept as simple as possible 
by using practice nurses to do single measures 
on a device they already were familiar with allow- 
ing easy implementation. 

■ This approach meant however that practice 
nurses did not receive extensive training and their 
performance may have been improved by said. 



INTRODUCTION 

Peripheral arterial disease (PAD) affects an 
estimated 27 million individuals in Europe 
and North America with 413 OOO related hos- 
pital discharges per annum. 1 2 These figures 
are likely to underestimate the true impact of 
PAD as those with the condition dispropor- 
tionally suffer from other manifestations of 
cardiovascular disease (CVD) and are there- 
fore likely to appear in coronary artery 
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disease or stroke statistics. As a consequence, there has 
been a call for better detection and management of the 
condition. 1 

One of the simplest and most useful parameters to 
objectively assess lower extremity arterial perfusion, and 
thus diagnose PAD, is the Ankle-Brachial Index (ABI). 
This is the lower of the left and right ABI where each ABI 
is the ratio of the lower limb systolic blood pressure com- 
pared to the higher systolic brachial blood pressure 
recording. The ABI can be used to screen for haemo- 
dynamic significant PAD and helps to define its severity. 
Patients with objectively documented PAD have a four- 
fold to sixfold increase in cardiovascular mortality over 
healthy age-matched individuals. 3 PAD is a stronger risk 
marker for myocardial and stroke morbidity and mortal- 
ity than those who have already had such an incident 
event. 4 5 However, only 50% of people with PAD are 
symptomatic which is a significant issue in the detection 
of PAD. 2 

Between 2007 and 2009, 19 500 oscillometric devices 
were distributed by the High Blood Pressure Research 
Council of Australia to physicians, mostly general practi- 
tioners (GPs). We had previously demonstrated that 
these devices were likely to improve blood pressure man- 
agement in primary care. 6 The current study, Ankle 
.Brachial Index .Determination by oscillometric method 
IN General practice (ABIDING), sought to expand the 
utility afforded by these machines in primary care. 
Previous work done in those attending a specialist vascu- 
lar laboratory in the US demonstrated that patients could 
have their ABI reliably ascertained by such devices com- 
pared to the conventional use of a Doppler ultrasound 
and mercury sphygmomanometer. 7 It was therefore 
opportune to investigate if such measures were pragmatic 
in primary care where the greatest opportunity exists to 
identify those with undiagnosed PAD. Such persons are 
at very high risk for subsequent adverse cardiovascular 
events that can be ameliorated through management of 
modifiable risk factors. 

The primary aim of ABIDING was to establish if there 
was agreement between a pragmatic ABI (measured by a 
practice nurse using an oscillometric blood pressure 
device) and a conventional ABI (measured by a research 
nurse using mercury sphygmomanometer and Doppler 
devices). A secondary aim was to ascertain diagnostic 
accuracy of the pragmatic approach for ascertaining PAD. 

METHODS 

GPs and participants were recruited through the 
REACH Registry Victorian database. The international 
REACH Registry was a prospective, observational registry 
designed to provide long-term follow-up (36 months) of 
patients at high risk of atherothrombotic events. 
Globally 67 888 patients were involved in the REACH 
registry of whom 2782 were recruited from 281 general 
practitioners around Australia. 8 9 Practices were eligible 
for ABIDING if they had previously enrolled participants 



in the REACH registry and had a practice nurse willing 
to participate or were willing to appoint a locum tenens 
nurse. Eligibility criteria for REACH are published else- 
where but can be summarised as at entry (March-June 
2004) aged 45+ years, had known CVD or at least three 
atherosclerosis risk factors, and were physically able to 
attend their usual general practice. 8 

Participant recruitment 

All Melbourne (metropolitan) and Warrnambool (rural) 
Victorian study participants who had consented to 
follow-up, who had been identified by their GPs as alive 
and for whom we had a current address, were contacted 
by mail. If no reply was received from the participant 
within 4 weeks, a second letter was sent and then a tele- 
phone call made. Participants were seen in their usual 
GP's clinic between October 2009 and November 2010. 

Research and practice nurses 

Three experienced research nurses conducted the refer- 
ence standard tests. They received standardised training 
from a senior research nurse who was one of the opera- 
tors. Practice nurses were given training in situ by the 
research nurse and were observed by them. Because 
they worked contemporaneously the research nurse was 
not blinded to the practice nurses results. 

'Conventional' and 'pragmatic' ABI estimation 

All participants were rested supine for 5 min before 
measurement. Doppler blood pressure measurements 
(by research nurse) and automated oscillometric blood 
pressure measurements (by practice nurse) were per- 
formed using cuffs that had bladders >80% of the diam- 
eter of the arms and ankles measured. 

Conventional measures involved Doppler blood pres- 
sure measurements in the lower limb made with a 
Nicolet Vascular Doppler with a 5 MHz probe. The cuff 
was inflated to 30 mm Hg above systolic blood pressure 
and deflated slowly until a flow signal was detected over 
the dorsalis pedis or posterior tibial arteries. Brachial 
artery systolic pressure was determined similarly but uti- 
lising a stethoscope rather than a Doppler. The ABI for 
each lower extremity was calculated as the pedal pres- 
sure divided by the higher of the two brachial pressures. 
PAD is defined as an ABI <0.9 in either lower limb. 10 
The mercury sphygmomanometer was calibrated by a 
certified laboratory. 

Research nurses were trained in the measurement of 
ABI and were certified prior to the start of the study. 
Practice nurses were simply observed and technique cor- 
rected if required. Oscillometric measurements were made 
by the practice nurse on all limbs using a standard auto- 
mated blood pressure cuff system (OMRON HEM-907, 
Omron Healthcare Singapore Pte Ltd, Singapore). This 
device is a validated blood pressure measurement 
device. 11 12 Oscillometric devices were new and therefore 
had factory calibration. Participants also completed the 
Edinburgh Claudication questionnaire (ECQ). 13 
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Statistical methods 

Descriptive analyses were used to investigate the agree- 
ment between the two procedures using the Bland and 
Airman method to determine whether measurements 
could be used interchangeably and if the correlation 
between ABI readings varied systematically. 14 Although 
the variability in the differences appeared to be propor- 
tional to the mean, applying a log transformation to the 
data did not substantially alter agreement and so raw 
scores are presented. Correlations between the paired 
readings were also calculated. Sensitivity, specificity, posi- 
tive and negative predictive values and accuracy with 
exact 95% CI are reported, where ABI readings taken 
under both conditions were dichotomised at 0.9 (refer- 
ence standard). The diagnostic accuracy was evaluated 
using Receiver Operating Curve analysis and quantified 
as the area under the curve (AUC or C statistic), as deter- 
mined using both univariable and multivariable logistic 
regression. In the multivariable model we adjusted for 
age, body mass index (BMI), gender and smoking status 
(never, former and current). The calibration of this 
model was validated using the Hosmer-Lemeshow statis- 
tic. 15 We examined likelihood ratios, the ratio of the 
expected test results in participants with PAD to those 
participants without. All results are reported with 95% 
CI. All analyses were conducted using Stata VI 2.0. 

Power calculations 

Assuming a type 1 error of 5% (a=0.05) a total sample 
of 250 participants provided 80% power to detect system- 
atic bias between the readings taken by the research and 
practice nurses if the mean difference was 0.0255. 14 
Eight participants were excluded as 6 pragmatic and 2 
conventional ABI readings were absent. In all other 
cases each patient had at least one conventional and 
pragmatic ABI reading (for the same leg). For a sample 
of 242 the difference that we could detect was 0.0257. 
We expected strong correlations between ABI readings 
taken using the different methods. Both calculations 
assumed a correlation between readings of 0.61 and SDs 
as reported in Benchimol et al. 16 

RESULTS 

The flow chart of the study is shown in figure 1. The 
characteristics of the ABIDING population are shown in 
table 1. There was no difference between those excluded 
and included in the analysis for any trait that we mea- 
sured. We also compared in table 1 those diagnosed 
with PAD versus not using conventional ABI. Those with 
PAD were older ( p=0.003) and more likely to be women 
(p=0.003). Figure 2 shows that there was poor agree- 
ment between pragmatic and conventional determin- 
ation of ABI with 95% of readings within ±0.4. Figure 3 
shows correlation between conventional and pragmatic 
ABI measurements, indicating a strong association 
between the two measurements, despite the poor agree- 
ment. The distribution of differences between the ABI 



measures is shown in figure 4. These differences were 
regressed on all possible confounders measured in our 
study, in both univariable and multivariable models. 
There were no significant associations, suggesting that 
the differences were completely random. 

A 2x2 table of dichotomised conventional and prag- 
matic measurements is shown (table 2). We examined 
the two groups comprising the 36 participants where the 
PAD classification differed. There were no differences 
in any measured trait between those groups (data 
not shown) . The respective pragmatic method diagnostic 
performance, assuming the conventional method as gold 
standard, was sensitivity 62% (95% CI 47% to 75%), spe- 
cificity 92% (87% to 95%), positive predictive value 67% 
(52% to 80%), negative predictive value 90% (85% to 
94%) and accuracy 85% (80% to 89%). The likelihood 
ratio for a positive result (LR+) was 7.3 (95% CI 4.4 to 
12.0) and likelihood ratio test for a negative result (LR— ) 
0.42 (0.30 to 0.59). Test performance for the asymptom- 
atic subgroup on ECQ (N=183 PAD 18%) sensitivity 54% 
(95% CI 37% to 69%) specificity 93% (89% to 97%) and 
symptomatic (N=18 PAD 61%) sensitivity 9% (2% to 
41%) specificity 57% (18% to 90%). Area under the 
Receiver Operator Characteristic curves (AUC/C statis- 
tic) of pragmatic ABI against the conventional ABI <0.9 
and thus PAD was 0.87 (95% CI 0.82 to 0.93). The AUC 
from multivariable analysis (adjusting for age, gender, 
BMI and smoking status) for all analyses were almost 
identical 89% (95% CI 84% to 93%) . 

Based on the differences in table 1 for those with 
PAD versus not we conducted a post hoc subgroup ana- 
lyses on pragmatic versus conventional ABI readings by 
gender, age (dichotomised as young or old) and all 
pairwise combinations. The agreement between 
reading and diagnostic criteria did not improve for any 
subgroup (data not shown). We also investigated (using 
multivariable logistic regression) whether there was any 
evidence that disagreements were systematic. There was 
no difference in disagreements apart from current 
smokers were more likely to produce readings that dis- 
agreed compared to non-smokers (p=0.025). A sub- 
group analysis with current smokers removed did not 
alter the diagnostic criteria of the tests. As could be 
expected in non-invasive testing there were no reported 
adverse events. 

Sensitivity analyses for excluding upper ABI cut point 
of 1.4 (concern regarding possible arterial incompress- 
ibility) did not affect the outcomes, and the range 
0.85-0.95 gave 0.85 sensitivity 54% and specificity 95%, 
and 0.95 sensitivity 71% and specificity 86%. 

DISCUSSION 

ABIDING demonstrated that use of oscillometric devices 
by general practice nurses to determine ABI and therefore 
the presence of PAD had high specificity (92%) and nega- 
tive predictive value (90%), good accuracy (84%) but 
modest sensitivity (62%) and positive predictive value 
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Eligible patients 
n-562 



Pragmatic test 
n = 250 



Excluded patients 

Reasons either 
not interested, 
deceased or not 
able to contact 

n = 312 







1 






ABI 0.9 
n = 49 






ABI >0.9 
n - 195 






Inconclusive result 
n = 6 







No conventional test 
n = 1 



No conventional test 
n = l 



Conventional test 
n = 4S 



Inconclusive 
n =0 



PAD present 

n = 32 



No conventional test 
n= 1 



Conventional test 
n = 194 



inconclusive 
H = 0 



PAD absent 
n = 16 



Conv entional test 
n = 5 



Inconclusive 
n = 0 



PAD present 



PAD absent 
n = 174 



PAD present 
n = 2 



PAD absent 
n = 3 



Figure 1 Flow diagram of a diagnostic accuracy in ABIDING as per STARD standard. 25 



(67%). The modest sensitivity and the LR+ 7.3 indicate 
that this test has little value for confirming the presence of 
PAD. On the contrary high specificity and negative predict- 
ive value suggests that the test has some value in ruling out 
the disease (ie, when the test is negative) . Looking at the 



symptomatic individuals as determined by ECQ showed 
that, though the numbers were small, the pragmatic 
measure had a poor performance as a diagnostic test in 
this high-prevalence (61%) subgroup. Changing the cut 
point to improve sensitivity or specificity simply 



Table 1 Characteristics of participants by conventional peripheral arterial disease status expressed as a mean (SD) or N (%) 


as appropriate 










Variable 


Included 


Conventional ABI>0.9 


Conventional ABI<0.9 


p for difference 


N 


242 


192 


52 




Age in years 


71.2 (7.4) 


70.4 (7.0) 


73.9 (8.3) 


0.003 


Male sex (%) 


167 (69.0) 


140 (73.7) 


27 (52.0) 


0.003 


SBP (mm Hg) 


141.5 (18.9) 


140.6 (17.8) 


144.5 (22.4) 


0.35 


DBP (mm Hg) 


76.7 (9.9) 


77.0 (9.8) 


75.5 (10.4) 


0.55 


BMI (kg/h 2 ) 


27.5 (4.4) 


27.5 (4.4) 


27.2 (4.4) 


0.63 


Waist 


99.9 (10.8) 


100.1 (10.4) 


99.2 (12.3) 


0.60 


Smoking status 








0.31 


Never 


98 (40.7) 


81 (42.9) 


17 (32.7) 




Former 


131 (54.4) 


100 (52.9) 


31 (59.6) 




Current 


12 (5.0) 


8 (4.2) 


4 (7.7) 




ABI, Ankle-Brachial Index; BMI, body mass index; DBP, diastolic blood pressure; SBP, systolic blood pressure. 
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Agreement between diagnostic ABI readings 



D istribution of differences 
between paired readings 



.5 1 
Mean of ABI readings 



|J 



lowtf limd or agrewnwt s -33 
upper limit oT agreement ts 32 



Figure 2 Agreement between pragmatic and conventional 
determination of Ankle-Brachial Index. 



compromised the other measure and therefore did not 
improve test performance. 

These findings were in contrast to the experience in a 
specialist centre where their test performance (both 
limbs in comparison to ABIDING lower of the two mea- 
sures) was sensitivity left/ right leg 88/73% (62%), speci- 
ficity 85/95% (92%), positive predictive value 65/88% 
(69%), negative predictive value 96/88% (90%), LR+ 
left/right leg 5.9/14.6 (7.9) and LR- 0.14/0.28 (0.4). 4 
A good diagnostic test has a LR+ >10 and LR- <0.1. 17 
This difference in performance to some extent may be 
accounted for by patient selection but is more likely due 
to operator expertise. In the specialist centre, the mean 
age was 10 years younger and 53% were women com- 
pared to only 22% in ABIDING. The respective preva- 
lence of PAD was 32% and 22%. In other studies 
reporting being conducted in primary care Mehlsen 
et al 18 enrolled 1258 consecutive general practice 
patients for an oscillometric determination of ABI, with 
those with an ABI <0.9 referred for a Doppler measure 
in a vascular unit. Hence all 'negatives' including false 
negatives did not have a gold standard measure and 



Correlation between readings 




Pragmatic ABI reading 

Figure 3 Correlation between pragmatic and conventional 
determination of Ankle-Brachial Index. 




-0.5 



0 0.5 
Conventional ABI - Pragmatic ABI 



1.0 



Figure 4 Distribution of the difference between the 
conventional and the pragmatic Ankle-Brachial Index 
readings. 



therefore this was not a true measure of test perform- 
ance in primary care. Nicholai et al 19 and Aboyens 20 had 
similar limitations. Verberk et af x conducted a systematic 
review of automated oscillometric devices including a 
subgroup analysis on devices developed for arm blood 
pressure (BP) measurement. Only 1 of the 18 studies 
identified was conducted in primary care and that with 
an ABIgram and not a simple BP arm device. 22 
Although the investigators demonstrated its reliability, 
the use of this special piece of equipment would seem 
to effect is acceptability as is the current situation. ABI is 
a valid and reliable clinical measure although an indir- 
ect one. The true gold standard would be an intravascu- 
lar perfusion study. Both methods have been compared 
to the true gold standard in 85 patients with claudica- 
tion undergoing angiography. 23 The oscillometric 
method showed 97% sensitivity, 89% specificity, 98% 
positive predictive value and 86% negative predictive 
value. The Doppler method showed 95% sensitivity, 56% 
specificity, 91% positive predictive value and 68% nega- 
tive predictive value. This study suggests that the oscillo- 
metric method had greater diagnostic accuracy but the 
test was performed by physicians not specifically trained 



Table 2 2x2 Table of conventional and pragmatic ABI 


determinations 








PAD positive 


PAD negative 




(conventional 


(conventional 




ABI<0.9) 


ABI>0.9) Total 


Test positive 


32 


16 48 


(pragmatic 






ABI <0.9) 






Test negative 


20 


174 194 


(pragmatic 






ABI >0.9) 






Total 


52 


190 242 


ABI, Ankle-Brachial Index; PAD, peripheral arterial disease. 
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to use the Doppler probe. This said ABI is a practical 
tool and is superior to clinical examination for identify- 
ing PAD. 20 However, screening whole populations is not 
always practical. ABI ascertainment of PAD is most effect- 
ive by identifying high-risk patients as we have done in 
ABIDING. By including high-risk and overt CVD patients 
we were confident that we should get a distribution of 
ABI scores that included PAD diagnostic scores and the 
outcome of the study supports this (22% had PAD by 
the conventional method) . 

If our method had been reliable it would have been 
readily implementable as Australian GPs have ready 
access to oscillometric sphygmomanometers. More than 
19 500 devices were distributed on behalf of the High 
Blood Pressure Research Council of Australia, mostly to 
GPs, over the years 2007-2009. Practice nurses were 
chosen rather than GPs as this approach is also more 
likely to be implementable. A survey by Mohler et af 4 of 
primary care clinicians showed that most (88%) thought 
ABI to be feasible in that setting. 

Study limitations 

The intervention was kept as simple as possible by using 
practice nurses to do single measures on a device they 
were familiar with but did not receive extensive further 
training on. While this means that this is simple to intro- 
duce into clinical practice the practice nurse perform- 
ance may have been improved by more intense training 
and repeated limb measurements. 

CONCLUSION 

Oscillometric ABI measures by primary care nurses on a 
population with a 22% prevalence of PAD lacked suffi- 
cient agreement with conventional measures to be 
recommended for routine diagnosis of PAD. This prag- 
matic method may however be used as a screening tool 
in high-risk primary care patients as it can reliably 
exclude the condition. 
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